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Abstract 

Linear max-plus systems describe the behavior of a large variety of complex systems. It is known 
that these systems show a periodic behavior after an initial transient phase. Assessment of the length 
of this transient phase provides important information on complexity measures of such systems, and 
f») • so is crucial in system design. We identify relevant parameters in a graph representation of these 

systems and propose a modular strategy to derive new upper bounds on the length of the transient 
. phase. By that we are the first to give asymptotically tight and potentially subquadratic transience 

bounds. We use our bounds to derive new complexity results, in particular in distributed computing. 

1 Introduction 

The behavior of many complex systems can be described by a sequence of ^-dimensional vectors x(n) 
that satisfy a recurrence relation of the form 

Vn > 1 Vi G {1, . . . ,N} : Xi(n) = max (xj(n - 1) + Aij) (1) 

where the Aij are real numbers, and the are subsets of {1, . . . , N}. For instance, Xi(n) may rep- 
resent the time of the nth occurence of a certain event i and the A»,j the required time lag between 
the (n — l)th occurence of j and the nth occurence of i. Notable examples are transportation and 
automated manufacturing systems [181 1121 IT5] . network synchronizers [231 116] . and cyclic schedul- 
ing [19]. Recently, Charron-Bost et al. [51 [9] have shown that it also encompasses the behavior of an 
important class of distributed algorithms, namely link reversal algorithms [IT], which can be used 
to solve a variety of problems [28] like routing [17] . scheduling [3], distributed queuing [271 [T], or 
resource allocation [Jj. 

Interestingly, recurrences of the form J!} are linear in the max-plus algebra (e.g., |21]1. The 
fundamental theorem in max-plus linear algebra — an analog of the Perron-Frobenius theorem — 
states that the sequence of powers of an irreducible max-plus matrix becomes periodic after a finite 
index called the transient of the matrix. As an immediate corollary, any linear max-plus system 
with irreducible system matrix is periodic from some index, called the transient of the system, which 
clearly depends on the system's initial vector and is at most equal to the transient of the matrix of 
the system. For all the above mentioned applications, the study of the transient plays a key role in 
characterizing the system performances: For example, in the case of link reversal routing, the system 
transient is equal to the time complexity of the routing algorithm. Besides that, understanding 
matrix and system transients is of interest on its own for the theory of max-plus algebra. 

Hartmann and Arguelles [2D] have shown that the transients of matrices and linear systems are 
computable in polynomial time. However, their algorithms provide no analysis of the transient 
phase, and do not hint at the parameters that influence matrix and system transients. Conversely, 
upper bounds involving these parameters help to predict the duration of the transient phase, and to 
define strategies to reduce transients during system design. From both numerical and methodological 
viewpoints, it is therefore important to determine accurate transience bounds. 

In this paper, we present two upper bounds on the transients of linear max-plus systems. Our 
approach is graph-theoretic in nature: The problem of bounding from above the transient can be 
reduced to the study of walks in a specific graph. More precisely, for every max-plus matrix A, one 
considers the weighted directed graph G whose adjacency matrix is A, and its critical subgraph which 
consists of the critical cycles, namely those cycles with maximal average weight. The entries of the 
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max-plus matrix power A® n are equal to the maximum weights of walks in G of length n between 
two fixed nodes, and when redefining the weights of walks in a way that respects initial vector v, 
the entries of A® n (g> v are maximum weights of walks of length n starting from a fixed node. The 
periodicity of matrix powers and linear systems stems from the fact that eventually the weights of 
critical cycles dominate the maximum weight walks. 

We present a general graph-based strategy whose core idea is a walk reduction Redd,fc, which 
removes cycles from a walk while assuring that its length remains in the same residue class modulo d, 
and that node k rests on the walk. The key property of Redd,fc is an upper bound on the length 
of the reduced walk that is linear both in d and the number of nodes in the graph. The following 
step in our strategy consists in completing reduced walks with critical cycles of appropriate lengths. 
For that, we propose two methods, namely the repetitive method and the explorative method. In 
the first one, the visit of the critical subgraph is confined to repeatedly follow only one closed walk 
whereas the second one consists in exploring one whole strongly connected component of the critical 
subgraph. That leads us to give two upper bounds on the transients of linear systems, namely the 
repetitive bound and the explorative bound, which are incomparable in general. We show that in the 
case of integer matrices, for a given initial vector, both our transience bounds for a yl-linear system 
are both in 0(||yl|| • JV 3 ), where ||j4|| denotes the difference of the maximum and minimum finite 
entries of A. We also show that this is asymptotically tight. 

Another contribution of this paper concerns the relationship between matrix and system tran- 
sients: We prove that the transient of an N x N matrix A coincides with the transient of an A-linear 
system with an initial vector whose norm is at most quadratic in N, provided the latter transient 
is sufficiently large. In addition to shedding new light on transients, this result provides two upper 
bounds on matrix transients. 

The problem of bounding the transients has already been studied (e.g., 20, 5, 26 ), and the best 
previously known bound has been given by Hartmann and Arguelles [2D]. Their bound on system 
transients is, in general, incomparable with our repetitive and explorative bounds. The significant 
benefit of our two new bounds is that each of them turns out to be linear in the size of the system 
in various classes of linear max-plus systems whereas Hartmann and Arguelles' bound is intrinsically 
at least quadratic. This is mainly due to the introduction of new graph parameters that enables a 
fine-grained analysis of the transient phase. In particular, we introduce the notion of the exploration 
penalty of a graph G as the least integer k with the property that, for every n ^ k divisible by the 
cyclicity of G and every node i of G, there is a closed path starting and ending at i of length n. One 
key point is then an at most quadratic upper bound on the exploration penalty which we derive from 
the number-theoretic Brauer's Theorem pf]. 

Finally, we demonstrate how our general transience bound enables the performance analysis of 
a large variety of distributed systems. First, we apply our results to the class of earliest schedules 
in cyclic scheduling: we show that for a large family of sets of tasks, earliest schedules correspond 
to linear max-plus systems with irreducible matrices. Thus we prove the eventual periodicity of 
such earliest schedules, and give two upper bounds on their transient phases. Then we derive two 
transience bounds for a large class of synchronizers, and we quantify how both our synchronizer 
bounds are better than that given by Even and Rajsbaum [16] in their specific case of integer delays. 
In the process, we show that our transience bounds are asymptotically tight. Our results also apply 
to the analysis of the performance of distributed routers and schedulers based on the link-reversal 
algorithms: We obtain 0(N 3 ) transience bounds, improving the 0(N 4 ) bound established by Malka 
and Rajsbaum [23] . and O(N) bounds for such routers and schedulers when running in trees. For 
link-reversal routers, eventual periodicity actually corresponds to termination, and an 0(N 2 ) bound 
on time complexity [6] directly follows from our transience bounds. 

The paper is organized as follows. Section [2] introduces basic notions of graph theory and max- 
plus algebra. In Section [3] we elaborate a graph-based strategy to prove transience bounds. We 
show an upper bound on lengths of maximum weight walks that do not visit the critical subgraph 
in Section 0] Section [S] presents a walk reduction that constitutes the core of our strategy. In 
Section [6] we introduce the notion of exploration penalty and improve a theorem by Denardo [14] 
on the existence of arbitrarily long walks in strongly connected graphs. We derive two transience 
bounds, namely the explorative and the repetitive bound, in Section [7] We show how to convert 
upper bounds on the transients of max-plus systems to upper bounds on the transients of max-plus 
matrices in Section [8] We discuss our results, by comparing them to previous work and by applying 
them to the analysis of various complex systems, in Section [pj 
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2 Preliminaries 



This section introduces definitions and classical results needed in the rest of the paper. We denote 
by IN the set of nonnegative integers and by IN* the set of positive integers. 

2.1 Graphs 

A directed graph G is a pair (V, E) where V is a nonempty finite set and E C V x V . The elements 
of V are the nodes of G and the elements of E the edges of G. In this paper, we refer to directed 
graphs simply as graphs. 

A walk W in G is a triple W = (Start, Edges, End) where Start and End are nodes in G, Edges 
is a sequence (ei,e2, . . . ,e n ) of edges e ; = such that ji = if 1 ^ I ^ n — 1, ii = Start 

and j n = End if the sequence Edges is nonempty, and Start = End if the sequence Edges is empty. 
We define the operators Start, Edges, and End on the set of walks by setting Start(W^) = Start, 
Edges(W) = Edges, and End(W) = End. We call Start (W) the start node of W and End(W) the 
end node of W . The length £(W) of W is defined as the length of the sequence Edges(W). Walk W 
is closed if StartfW) = EndlW). Walk W is empty if the sequence Edges(W) is empty. A walk W 
is empty if and only if £(W) = 0. 

For two walks W and W', we say that W' is a prefix of W if Start(W) = Start(VF') and the 
sequence Edges(W // ) is a prefix of Edges(W). We say that W' is a postfix of W if End(W) = End(W // ) 
and the sequence Edges(W / ") is a postfix of Edges(VF). We call W a subwalk of W if it is the 
postfix of some prefix of W. A subwalk W' of W is a proper subwalk of W if W' =fc W. We 
say a node i is a node of walk W if there exists a prefix W' of W with End(W') = i. For two 
walks VKi and Wi with End(VKi) = Start(W / 2), we define the concatenation W = Wi ■ Wi by setting 
Start(W) = Start(Wi), End(VK) = End(VK2), and Edges(W / ) to be the juxtaposition of the sequences 
Edges(W / i) and Edges(W / 2 ). If W = Wi ■ C ■ W 2 where C is a closed walk, then W = Wi ■ W 2 is also 
a walk with the same start and end nodes as W. 

A walk is a path if it is non-closed and does not contain a nonempty closed walk as a subwalk. A 
closed walk is a cycle if it does not contain a nonempty closed walk as a proper subwalk. As cycles 
can be empty, there is a cycle of length at each node of G. 

If i and j are two nodes of G, let Wg denote the set of walks W in graph G with Start(W^) = i 
and End(W / ) = j, and Wg(s- ►) the set of walks W in G with Start(W / ) — i. If n is a nonnegative 
integer, we write Wg(i,j) (respectively Wg(i— >)) for the set of walks in Wg(*,j) (respectively 
Wg(*— 0) °f length n. When no confusion can arise, we will omit the subscript G. 

A graph G' = (V, E') is a subgraph of G if V C V and E' C E. For a nonempty subset E' oi E, 
let the subgraph of G induced by edge set E' be the graph (V',E') where V' = {i € V \ 3j € V : 
{i,j) € E' V (j, i) G £'}. A graph G is strongly connected if, for all nodes i and j in G, there exists a 
walk from i to j. A subgraph of G is a strongly connected component of G if # is maximal with 
respect to the subgraph relation such that H is strongly connected. 

The girth g(G) of a graph G is the minimum length of a nonempty cycle in G. For a strongly 
connected graph G, its cyclicity 7(G) is the greatest common divisor of cycle lengths in G. If G is 
not strongly connected, then its cyclicity 7(G) is equal to the least common multiple of the cyclicities 
of its strongly connected components. 

2.2 Linear max-plus systems 

Let R = E, U { — 00}. In this paper, we follow the convention max0 = —00. 

A matrix with entries in R is called a max-plus matrix. If A is an M x iV max-plus matrix and B 
is an iV x Q max-plus matrix, then the max-plus product AgBisanMxQ max-plus matrix defined 



If A is an N x N max-plus matrix and n is a nonnegative integer, we denote by A® n the n times 
iterated matrix product of A. That is, (A®°) M = and (A m ) tJ = -00 if i / j, and A® n = 
A <g> J 4 ( 8( n_1 ) if n > 1. Given a column vector v G R^, the corresponding linear max-plus system is 
the sequence of vectors x(n) defined by 



by 



(A ® B)ij 



— max 



(Ai, fc + B k ,j) ■ 




(2) 
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Clearly x(n) = A® n ® v. Let x — (A,v), i.e., (A,v) denotes the A-linear system with the initial 
vector v. 

To an TV x TV max-plus matrix A naturally corresponds a graph G(A) with set of nodes {1, . . . , TV} 
containing an edge if and only if Aij is finite. The matrix A is said to be irreducible if G(A) 

is strongly connected. 

We refer to Aij as the A-weight of edge (i, j) in G(A). If W is a walk in G(A), we abuse notation 
by writing yl(W^) for the weight of walk W , i.e., the sum of the weights of its edges. We follow the 
convention that the value of the empty sum is zero, i.e., = if W is an empty walk. Given a 

— N 

column vector v G HI , we write A V (W) = A(W) + Vj where j = End(VT) for W's A v -weight. From 
these definitions, one can easily establish the following correspondence between the matrix power 
A® n (respectively the vector A® n ® v) and the weights of some walks in G(A). 

Proposition 1. Let i and j be two nodes of G(A), and let n be a nonnegative integer. Then the 
following equations hold 

(A® n )ij = max{A(W/) | W G W^ A) (i,j)} 
{A® n ® v)t = max {A V (W) | W G WS (A) (i-)-)} . 

2.3 The critical subgraph 

A nonempty closed walk C in G(A) is said to be critical if its average A-weight A(C) / £(C) is maximal, 
i.e., if it is equal to 

\(A) = max {A(C)/£(C) C is a nonempty closed walk in G(A)} , 

which is easily seen to be finite whenever there is at least one cycle in G(A). A node of G(A) is 
critical if it is a node of a critical closed walk in G(A), and an edge of G(A) is critical if it is an edge 
of a critical closed walk in G(A). The critical subgraph of G(A), denoted by G C (A), is the subgraph 
of G(A) induced by the set of critical edges of G(A). We recall a useful property of closed walks in 
G C (A) (for instance see |211 Lemma 2.6] for a proof). 

Proposition 2. Every nonempty closed walk in G C (A) is critical in G(A). 
Let us denote 7(A) = -y(G c (A)). 

2.4 Eventually periodic sequences 

Let I be an arbitrary nonempty set and / : IN — > IR/. Further let n be a positive integer and p£K. 
The sequence / is eventually periodic with period n and ratio g if there exists a nonnegative integer 
T such that 

Vi G / : \/n^T : fi(n + tt) = /,(n) + tt ■ g . (3) 

We call such a T a transient of / with respect to tt and p. The ratio is unique if not all component- 
wise sequences {fi{n)) n are eventually constantly equal to —00. In all cases, the set of transients 
of / is independent of the ratio. 

Obviously if a is any multiple of tt, then / is also eventually periodic with period a and ratio g. 
Hence, there always exists a common period of two eventually periodic sequences. 

For every period 7T, there exists a unique minimal transient T T . The next lemma shows that 
these minimal transients do, in fact, not depend on tt. We will henceforth call this common value 
the transient of /. 

Proposition 3. Let n and a be two periods of an eventually periodic sequence f with respective 
minimal transients T n and T a . Then T^ = T CT . 

Proof. Denote by 11/ the set of periods of / and by g a ratio of /. Clearly, II/ is a nonempty subset of 
IN* closed under addition. Let iro = mini!/ be the minimal period of /; hence 7rolN* C II/. Denote 
by To the minimal transient with respect to period no G II/. Let n — ano + b be the Euclidean 
division of n by tto- For any integer n max{T^,To — b}, 

f(n + 7r) = f(n) +irg = f(n + b) + aTY g . 

It follows that either b — or b is a period of /. Since b ^ no — 1 and no is the smallest period of /, 
we have 6 = 0, i.e., no divides n. We have thus shown II/ C 7TolN* and thus II/ = 7roIN*. Hence 
7r = ano for some positive integer a. 

Since for any n ^ To, f(n + ano) = f(n) + anog, we have Tr ^ To. We now prove that Tr = To 
by induction on a. 
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1. The base case a = 1 is trivial. 

2. Let a 2. Denote by T' the minimal transient with respect to period (a — l)7ro- By the 
inductive hypothesis, T' — Tq. For any integer n ^ T v , 

f(n + an ) = f{n) + an Q . (4) 

Moreover, if n + no ^ T' then 

f(n + an ) = /(n + 7r ) + (a - l)7r £> . (5) 

It follows that for any integer n ^ max{T' — no,T n }, 

f(n + 7T ) = f(n) + ir Q ■ (6) 

Hence To ^ max{T' — no, T^}, and by inductive assumption To ^ max{To — no, T^}. We derive 
To ^Ttt, and so To = T^, which concludes the proof. □ 

Cohen et al. proved eventual periodicity of irreducible max-plus matrix powers in the following 
analog of the Perron-Frobenius theorem in classical linear algebra. 

Theorem 1 (Cyclicity Theorem [TT]). If A is irreducible, then the sequence of matrix powers A® n 
is eventually periodic with period "/(A) and ratio \{A). 

Consequently, every linear max-plus system with an irreducible matrix A is eventually periodic 
with period j(A) and ratio X(A). 

We call the transient of the sequence of matrix powers A® n the transient of matrix A, and the 
transient of the sequence of vectors A® n (g> v the transient of the system {A, v). 

For any fj, € R, let A + /x denote the matrix obtained by adding fi to each entry of A. Since 
(A + (i)® n = A® n + np,, we easily check that G C (A + n) = G C (A), X(A + fi) = \(A) + fi, and the 
matrix transients of A and A + fi (resp. the system transients of {A, v) and {A + fx,v)) are equal. 



3 Strategy Outline 

This section describes our graph-based strategy to prove upper bounds on the transient of the 
system (A,v), given an irreducible N x N matrix A and a vector v £ R JV . We also explain how a 
slight modification of this strategy provides upper bounds on the transient of A. 

We start by defining for a set N of nonnegative integers and a node i, an N-realizer for node i 
to be any walk of maximum ^4„-weight in the set of walks in W(z— >) with length in N. As shown in 
the next proposition, of particular interest is the case of sets N of the form 

Nl^ 7r) = {me!N|m>B A m = n (mod n)} 

where B, n, and n are positive integers. 

Proposition 4. Let B and n be positive integers. If there exists, for every node i and every inte- 
ger n ^ B, an N^g^' -realizer for i of length n, then B is an upper bound on the system transient. 

Proof. Let i be a node. For each integer n ^ B, let W n be an -realizer for i of length n. 

Denote by X{n) the set of walks W in W(i— >) with £(W) £ , and let x(n) be the maximum 

of values A V (W) where W G X(n). It is x{n) = A v (W n ). 

From n + n = n (mod n) follows X(n + n) = X(n) and so x(n + n) = x(n). Moreover, 
we have W"{i^) C X[n) and W n+7r (i^) C X(n + n), which implies {A® n ® v) t < x(n) and 
{A^ n+1T) g> v)i < x(n + tt). Conversely because W n £ W n (i->), we have (.4®" ® «)< > A(W„) = 
x(n). Similarly, (>l ( »( n +' r ) jg w ) t ^ ^(IVn+Tr) = x(n + n). Since x(n + tt) = x(n), it follows that 
(A® n ® u)i = (yl <gi ujj. Noting Proposition [3] now concludes the proof. □ 

Based on Proposition [4] we now define a strategy for determining upper bounds on system 
transients. Let n be a nonnegative integer and i be a node. Denote by n the least common multiple 
of cycle lengths in the critical subgraph G c . Note that n is a multiple of 7 = "/(A). The strategy 
includes an additional parameter B to be chosen in step 4. 

1. Normalized matrix. Because the transients of A and of A = A — X(A) are equal, and X(A) = 0, 
we can reduce the general case to the case X(A) = 0. The condition X(A) — guarantees the 
existence of realizers for every nonempty N C IN and yields that adding critical cycles to a walk 
does not change its A- weight. The rest of the strategy hence considers an irreducible matrix A 
such that X(A) — 0. Let W be an N^^'-realizer for node i. 
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2. Critical bound. We show that for B large enough, i.e., B greater or equal to some critical 
bound B c , the realizer W contains at least one critical node k. 

3. Walk reduction. Next we show that for every divisor d of 7r, by removing subcycles, we can 
reduce W to a new walk W which starts at node i, contains the critical node k, whose length 
£(W) is in the same residue class modulo d as £(W), and £(W) is upper-bounded by a term 
linear in the number of nodes in the graph. 

4. Pumping in the critical graph. Since d divides ir, d divides n — £(W), and for two appropriate 
choices of d and for n sufficiently large (n Bd), we show how to complete W by adding to 
it a critical closed walk starting from k in order to obtain a new walk of length n starting at 
node i. 

For B — max{73 c , Bd], this yields an -realizer of length n, because removing cycles 

at most increases the weight and adding a critical closed path does not change the weight. 
Proposition [4] then shows that B is a bound on the transient. 

For the transient of the matrix A, we can follow a similar strategy: we consider W(i, j) instead 
of W(i— >), and for a set N of nonnegative integers we define an N-realizer for the pair of nodes i, j 
to be any walk of maximum A-weight in the set of walks W(i, j) with length in N. As for walks in 
W(i— >), we can show that any walk of maximum A- weight in W(i,j) with length in N^, contains 
at least one critical node if B is greater or equal to some critical bound B' c . Since the walk reduction 
described above actually preserves both the starting and ending nodes, then we can derive an upper- 
bound on the transient of A. In fact, we will not develop this parallel strategy for matrices, but we 
rather propose a different method, which consists in computing a bound on the transient of matrix A 
from our bounds on transients of some specific systems (A,v). 

4 Critical Bound 

In this section, we carry out step 2 of our strategy. More precisely, we prove that any walk of 
maximum A„-weight in the set of walks W n (i— >) necessarily contains a critical node if n is large 
enough. 

Let A be an TV x TV max-plus matrix, and assume A is irreducible. We write A for X(A), A nc for the 
maximum average A- weight of closed walks without critical nodes, 8 for the minimum A- weight, A 
for the maximum A-weight, A nc for the maximum A-weight of edges between non-critical nodes, 
and 1 1 V 1 1 for the difference of the maximum and minimum entry of vector v. We assume \\v\\ to be 
finite until Section [5] in which we generalize our results to arbitrary v. By comparing the possible 
A^-weights of walks that do and do not visit G c , we can derive an explicit critical bound B c , which 
holds for arbitrary A. 

Proposition 5 (Critical Bound). Each walk with maximum A v -weight in W n (i— contains a critical 
node if n ^ B c where 

B c = m ^N, IHI + (*-!)} 
1^ A — A llc J 

Proof. We first reduce to the case A = 0. Let A be the normalized matrix A = A — A. The 
parameters S, A nc , and A nc for the matrix A are obtained by subtracting A from the respective 
parameters of A. Hence A = 0, and a walk is of maximum A^-weight in G(A) if and only if it 
is a walk of maximum A v -weig ht in G(A) = G(A). The term ll " ll+(A A "^ c ) (JV ~ 1) should hence be 
substituted by H 1I II + ( A °'^~' 5 ) (n- 1 ) wnen considering A instead of A, and we can assume A = in the 
rest of the proof. 

If Anc = — ex), then every nonempty cycle contains a critical node. Because every walk of length 
greater or equal to TV necessarily contains a cycle as a subwalk and because B c TV, in particular 
every walk with maximum A^-weight in W n (i— >) contains a critical node if n ^ B c and A nc = — oo. 

We now consider the case A nc 7^ — 00. We proceed by contradiction: Suppose that there exists an 
integer n such that n ^ B c , a node i and a walk of maximum A„-weight in W n (i— >) with non-critical 
nodes only; let W be such a walk. Let Wo be the acyclic part of W, defined in the following manner: 
Starting at W, we repeatedly remove nonempty subcycles from the walk until we arrive at a path. 
In general there are several possible choices of which subcycles to remove, but we fix some global 
choice function to make the construction of Wo deterministic. 

Next choose a critical node k, and then a prefix W c of Wo, such that the distance between k and 
the end node of W c is minimal. Let W2 be a path of minimal length from the end node of W c to k. 
Let W3 be the walk such that Wo = W c ■ W3. Further let C be a critical cycle starting at k. 



G 



We distinguish two cases for n, namely (a) n ^ i(W c ) + £(W 2 ), and (b) n < £(W C ) + £(W 2 ). 

Case a: Let m £ IN be the quotient in the Euclidean division of n — £(W C ) ~ £(W 2 ) by £(C), and 
choose Wi to be a prefix of C of length n - (l(W c ) + £(W 2 ) + m ■ 1(C)) (cf. Figure Q. Clearly W\ 
starts at ft. If we set W = W c ■ W 2 ■ C m ■ Wi, we get = n and 

A V (W)> min ( Vj ) + A(Wo) + A(W 2 ) + A(Wi) (7) 

since we assume A = 0. 




Figure 1: Walk W in proof of Proposition [S] 

For the ^-weight of W, we have 

A V (W) < A V (W ) + \nc-(£(W) - e(W )) < I mjmt r (wj) + A(W ) + A nc -(f(IF) - £(W )) (8) 

By assumption A^(W') ^ Au(W), and from 0, ©, and A nc < we therefore obtain 
£(W) ^ \\v\\+A(W 3 )-A(W 1 )-A(W2) + £{Wo) ^ \\v\\ + A nc e(W 3 )-S(e(W 1 )+e(W 2 )) + ^ 



"Anc 



-A n 



(9) 



Denote by N nc the number of non-critical nodes. The following three inequalities trivially hold: 
£(W 3 ) $J JVnc — 1, A nc S, and £(Wi) < N ~ N nc . Since there is at least one critical node, we 
have £(W-i) < N — 1. Moreover from the minimality constraint for the length of W 2 follows that 
£(W 2 )+£(W ) < N nc - Thereby 



£(W) < 



H + (Anc-<*) (N-l) 

— Aug 



(10) 



a contradiction to n ^ B c . The lemma follows for case a. 



Case b: In this case £(W C ) < n < £(W C ) + £(W 2 ), and we set W = W c ■ W 2 , where W 2 is a prefix 
of W2, such that £(W) = n. Hence, 



A V (W) > ^in^fe) + A(Wc) + ^(W^) 



(11) 



We again obtain (|SJ). By assumption j4„(VF) > Au(W), and by similar arguments as in case a we 
derive 

£(W)^^ + A ^- A ^ + £(W ) 

— Anc 

and since W 2 is a prefix of W 2 with £{W 2 ) < £{W 2 ), 



Anc 

which is less or equal to the bound obtained in (|9j) of case a. By similar arguments as in case a, the 
lemma follows in case b . □ 
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In case A is an integer matrix, i.e., all finite entries of A are integers, the term A — A nc cannot 
become arbitrarily small: This is obvious when A nc = — oo; otherwise, let Co be a critical cycle, and 
let Ci be a cycle such that A nc = A(Ci)/£(Ci). Then we have 

. _ . A(C )£{Ci) - A(Ci)e{C ) 

and so 

, \ < (N - N nc ) ■ N nc < ?L , (12) 

A — A nc 4 
where N nc denotes the number of non-critical nodes. It follows that, in case of integer matrices, the 
critical bound B c is in 0(\\A\\ ■ N s ) for a given initial vector. 



5 Walk Reduction 

This section concerns step 3 of our strategy and constitutes its core. Given a walk W , a positive 
integer d, and a node k of W, we define a reduced walk, denoted Redd,k(W), such that (a) it contains 
node k and has the same start and end nodes as W , (b) its length is in the same residue class modulo d 
as W's length, and (c) its length is bounded by (d — 1) + 2d(N — 1). 

Properties (a) and (b) can be achieved by removing a collection of cycles from W whose combined 
length is divisible by d and whose removal retains connectivity to k. The key point of the reduction 
is that we can iterate this cycle removal until the resulting length is at most (d — 1) + 2d(N — 1). 

We call a finite, possibly empty, sequence of nonempty subcycles S = (Ci,C2, . . . ,C n ) a cycle 
pattern of a walk W if there exist walks Uo, U\, . . . , U n such that 

W = U • Ci • Ui ■ C 2 • ■ ■ U n -! -C n -U n . (13) 

The choice of the U m 's in (|13[) may be not unique, and we fix some global choice function to make 
it deterministic. Then we define the removal of S from W as 

Rem(W, S) = U ■ Ui ■ ■ ■ U n . 

The walks W and Hem(W,S) have the same start and end nodes. Furthermore £(Jiem(W,S)) = 
£{W) - 1{S) where £(S) = T,ces £ ( C )- In particular, Rem(W,5) = W if and only if £(S) = 0, i.e., 
S is the empty cycle pattern. 

Given any node k of a walk W, let Sk(W) denote the set of cycle pattern S of W whose removal 
does not impair connectivity to k, i.e., k is a node of Rem(W, S) . Further for any positive integer d, 
define Sd,fc(W) as the subset of cycle pattern S € Sk(W) that, in addition, leave the length's residue 
class modulo d intact, i.e., £(S) = (mod d). The set Sd,k{W) is not empty, because k is a node 
of W and we can hence choose S to be the empty cycle pattern. 

Choose S € Sd,k(W) such that £(S) is maximal. There may be several possible choices for S, 
and we again fix some global choice function to make the choice deterministic; then set 

Ste Pd , fe (W0=Rem(W;S) • 

The limit 

Red d ,k(W) = lim Step* k ( W) 

exists because the sequence of walks (Step^ k {W))t^o is stationary after at most £(W) steps, and we 
call it the (d, k)-reduction ofW. More specifically, Red(j,fc(W) = W if and only if S<j,fc(W r ) is reduced 
to the sole empty cycle pattern. The walks W and Redd,fe(W^) have the same start and end nodes. 
Also, k is a node of Red d , k (W) and £(Red dtk (W)) = £{W) (mod d). 

Bounding the length of Redd t k{W) relies on a simple arithmetic lemma which is an elementary 
application of the pigeonhole principle: 

Lemma 1. Let d be a positive integer and let x\, ...,Xd £ Z. Then there exists a nonempty set 
I Q {1) ■ ■ ■ ,d} such that Xi = (mod d). 

iei 

Theorem 2. For each positive integer d and each node k, the length of the (d,k) -reduction of any 
walk W containing node k is at most equal to (d — 1) + 2d ■ (N — 1): 

£(Red d , k (W)) < (d - 1) + 2d ■ (N - 1) . 



8 



Proof. We denote W = Red<j,A,(VF). By definition of the (d, fc)-reduction, Redd,k(W) = W. Let S 
be any cycle pattern of W in Sfc(lF), and let n be the number of cycles of S. We first show that 
n ^ d — 1. Indeed, suppose for contradiction that n ^ d. Then Lemma [T] implies that there exists a 
nonempty subsequence of 5 that is in Sd,k(W), which contradicts Red £ j i fc(M / ) = W. 

Now let us choose S in Sfc(lF) with maximal £(S). If <5> = (C\,C2, ■ ■ ■ ,C„), then there exist 
walks Uo,Ui, . . . ,U n such that 

W = U -Ci-Ui-C a --- U n -i -C n -U n . 




Figure 2: Structure of the reduced walk W — Redd,k(W) 



By definition of Sk(W), k is a node of Rem(W,S). Hence there exists some index r such that k 
is a node of U T . Each U m with m/risa (possibly empty) path, because otherwise we could add a 
nonempty subcycle of U m to S, a contradiction to the maximality of t(S). Similarly, if U r = W\ ■ W2 
such that k is the end node of Wi, then both Wi and W2 are (possibly empty) paths. Hence, apart 
from the at most (d — 1) cycles in S, the reduced walk W consists of at most (d + 1) subpaths. 
Noting that each cycle has length at most N and each path has length at most (N — 1) concludes 
the proof. □ 



6 Exploration Penalty 

One of the two pumping techniques that we develop in step 4 of our strategy for the construction 
of arbitrarily long closed walks in the critical graph G c consists in exploring one strongly connected 
component H of G c - The closed walks keep inside H, but may visit any node in H. For that, we 
first introduce for a strongly connected graph G the exploration penalty of G, ep(G), as the smallest 
integer e such that for any node i and any integer n ^ e that is a multiple of G's cyclicity, there 
is a closed walk of length n starting at i. The exploration penalty can be seen as the transient of 
diagonal entries in the sequence of Boolean matrix powers of the graph's adjacency matrix. For us, 
it constitutes a threshold to pump walk lengths in multiples of the cyclicity. We prove that ep(G) is 
finite, and from Brauer's Theorem [3] we derive an upper bound on ep(G) that is quadratic in the 
number of nodes of G. This generalizes a theorem by Denardo [14! for strongly connected graphs 
that are primitive, i.e., with cyclicity equal to 1. 

Theorem 3. Let G be a strongly connected graph with N nodes, of girth g and cyclicity 7. The 
exploration penalty of G, denoted ep, is finite and satisfies the inequality 

ep < min ( N + (N - 2)g , 2^N - $■ - 2g + 7} . 

I 7 7 J 

After proving Theorem [3] the authors learned that the problem of bounding the exploration 
penalty has already been studied by several authors (e.g., see [22] for a survey). Two bounds that 
do not include the girth g as a parameter were given by Wielandt 29 for primitive graphs and 
by Schwarz [25] for the general case. Wielandt's bound on the exploration penalty of a primitive 
strongly connected graph with nodes is called the Wielandt number W(N) = N 2 — 2N + 2. Schwarz 
generalized this result to arbitrary cyclicities 7 and arrived at a bound of 7 ■ IF ( L-/V/7J ) +(N mod 7). 
To the best of our knowledge, our new bound in Theorem [3] is the first one for non-primitive graphs 
that includes the girth g as a parameter. In general, it is incomparable with the bound of Schwarz 
and shows the effect of the girth g on the exploration penalty as the leading term in Schwarz' bound 
is iV 2 /7 whereas ours is at most 2Ng/j. 

The rest of this section is devoted to the proof of Theorem [3] If 7 = 1, then iV + (N — 2)g 
2gN/-y — g/*y — 2g + 7, and the inequality ep ^ N + (N — 2)g is actually a result by Denardo [141 
Corollary 1]. Otherwise 7^2, and we easily check that N + (N — 2)g ^ 2gN/ r y — 3/7 — 2g + 7. In 
this case, we thus have to prove the inequality ep ^ 2gN/ r y — g/j — 2g + 7. 
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For any pair of nodes i and j, let Ni,j be the set of integers denned by 

N w = {n6Wf* |W n (i,j)/0} . 

Clearly each N^j is nonempty and closed under addition; let di = gcd(N;,i). Since G is strongly 
connected, 

7 = gcd({di i is a node in G}) . 

Let N be any nonempty set of positive integers. We call a subset A C N a gcd-generator of N if 
gcd(A) = gcd(N)Q 

Lemma 2. A nonempty set N of positive integers that is closed under addition contains all but a 
finite number of multiples of its greatest common divisor. Moreover, if {a±, . . . , at} is a finite gcd- 
generator of N with ai ^ . . . ^ a,k, then any multiple n oj d = gcd(N) such that n ^ (ai—d)(a,],—d)/d 
is in N. 

Proof. Consider the set M of all the elements in N, divided by d = gcd(N). By Brauer's Theorem [4], 
we know that every integer m ^ — 1)(^ L — 1) is of the form 

k 

i=i 

where each xt is a nonnegative integer. Since N is closed under addition, it follows that every multiple 
of d that is greater or equal to (ai — d)(ak — d)/d is in N. In particular, all but a finite number of 
multiples of d are in N. □ 

Lemma 3. For any node i, di — 7. Moreover, for any pair of nodes i,j, all the elements in Ni.., 
have the same residue modulo 7. 

Proof. Let i,j be any pair of nodes, and let a £ Nij and b G Nj^. The concatenation of a walk 
from i to j with a walk from j to i is a closed walk starting at i. Hence a + b £ N;^. From Lemma[2] 
we know that Njj contains all the multiples of dj greater than some integer. Consider any such 
multiple kdj with k and di relatively prime integers. By inserting one corresponding closed walk at 
node j into the closed walk at i with length a + b, we obtain a new closed walk starting at i, i.e., 
a + kdj + b £ Ni,j. It follows that di divides both a + b and a + kdj + b, and so di divides dj. Similarly, 
we prove that dj divides di, and so di = dj. Because 7 is the gcd of the di's, the common value of 
the di's is actually equal to 7. 

Let a and a' be two integers in N^j. The above argument shows that both a + b and a' + b are 
in Nj,j. Hence 7 divides a + b and a' + b, and so also a — a' . □ 

Lemma 4. For any node i, the set Wi,i admits a gcd-generator that contains the lengths of all the 
cycles starting at i, and whose all elements n satisfy the inequality g ^ n ^ 2N — 1. 

Proof. Let i be any node of G, and let Go be any cycle. Let W\ be one of the shortest paths 
from i to Go, and set j — End(W / i). Without loss of generality, Start(Go) = j. By definition, 
£(Wi) ^ iV — £(Co). Then consider a path W2 from j to i, and the two closed walks 

W = Wi ■ W 2 and W' = Wx ■ C ■ W 2 . 

Note that 

£(W) < £{W) < 2N - 1 . 
Moreover if the walk W is nonempty, then 

because is closed. In the particular case j is a node of Go, W is the empty walk starting at i, W 1 
reduces to Go, and £(W') is the length of the cycle Go- 

Let Ni be the set of the lengths of the nonempty closed walks W and W' when considering all 
the cycles Co in G. Then, Ni contains the length of all the cycles starting at i. Let Si — gcd(Ni). 
Since Ni C N^j, di divides Si. Conversely, let Go be any cycle, and let W and W 1 be the two 
closed walks starting at node i defined above; Si divides both £(W) and £(W'), and so divides 
£{W) — £(W) = £(Co). Hence, Si divides the length of any cycle, i.e., Si divides 7. By Lemma [3] it 
follows that Si divides di. Consequently, Si = di, i.e., Ni is a gcd-generator of Ni,i. □ 

As % is Noetherian, any nonempty set of positive integers admits a finite gcd-generator. 
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Lemma 5. For any node i and any integer n such that n is a multiple of 7 and n ^ 2Ng/y — g/j — 
2g + 7, there exists a closed walk of length n starting at i. 

Proof. Let i be any node, and let Co be any cycle such that £(Co) ~ <?• Let W\ be one of the shortest 
walks from i to Co, and set j = EndCW^i). Without loss of generality, Start(Co) = j. By definition, 
£(Wi) sC N ~ g. Then consider a path Wi from j to i; we have £(W 2 ) < N - 1. The walk Wi • W 2 
is closed at node i, and so 7 divides £(Wi) + i(Wi). Hence, if 7 divides some integer n, then 7 also 
divides n — £(Wi) — £(W 2 ) ■ It is g G N^,j . By LemmaU] there exists a gcd-generator Nj of Njj such 
that g G N j and g < n < 2iV - 1 for all n G Nj . 

By Lemma [2] for any n such that n' = n — £(Wi) — £{Wz) is a multiple of 7 and 

»'-(H(^-')' 

there exists a closed walk C starting at node j of length £(C) = n' . Note that 

y(l-l) ( 2 -^-l)+(N- g ) + (N-l)=2°N-!L- 2 g + 7 . 

\7 / v 7 y 77 

In this way, for any integer n ^ 2Ng/f — (7/7 — 2g + 7 that is a multiple of 7, we construct 
W = Wi • C • W2 that is a closed walk at node i of length n. □ 

Theorem [3] immediately follows from Lemma [5] 



7 Repetitive and Explorative Transience Bounds 

We now follow the strategy laid out in Section|3]to prove two new bounds on system transients. They 
mainly differ in step 4 of the strategy, namely, in the way one completes the reduced walk Kedd,k(W) 
with critical closed walks to reach the desired length n. Naturally this has implications on the 
appropriate choices for the walk reduction parameters d and k used in step 3. 

Let A be an irreducible N x N max-plus matrix with A (A) = 0, and let v be a vector in R w . 
Recall that ir is chosen to be the least common multiple of cycle lengths in the critical subgraph G c . 
Let i be any node, and let B and n be two positive integers such that n ^ B ^ B c . Since X(A) = 0, 
there exists a walk W that is an Nl^'-realizer for node i. By definition of N^"', £(W) ^ B, and 
walk W is a {^(W / )}-realizer for node i. Proposition [5] shows that W contains at least one critical 
node k. Let H denote the strongly connected component of G c containing k. 

We consider d to be any divisor of n. By construction, W — Redd i fe(W / ) is obtained by removing 
a collection of cycles from W, and starts at the same node i as W. Since X(A) = 0, this implies 

A V (W) > A V (W) . (14) 

Moreover, walk W contains the critical node k, and its length £(W) is in the same residue class 
modulo d as £(W). By Theorem [2] we have 

£(W) (d - 1) + 2d ■ (N - 1) . (15) 

For the repetitive bound, we use a single critical cycle C to complete W] see Figure [3(a)| Let C 
be a cycle with length equal to the girth g(H). We can assume that k is a node of C: In case k is 
not a node of C, we modify W by inserting n copies of a critical closed walk in H that connects W 
to C. Indeed, the addition of this critical closed walk changes neither the residue class modulo n nor 
the A„-weight since X(A) = 0. We now choose 

d = g(H) . 

From (HSJ, we derive that n £(W) when B > {g{H) - 1) + 2g(H) ■ (jV - 1), and we complete the 
reduced walk W to length n by adding copies of C. 
For the explorative bound, we choose 

d = 7(H) 

and use the definition of the exploration penalty ep(H). From (|15|l . we derive that n ^ l(W) + ep(H) 
whenB > (j(H) -l) + 2j(H) ■ (N -1) +ep(H). By definition of ep(H) and since n-£(W) > ep(iJ), 



we can complete W to length n by a critical closed walk in //; see Figure 3(b) 

In each of the two completions, the resulting walk is of length n, starts at node i, and ends at 
the same node as W. With (|14p . we deduce that its j4„-weight is at least A V (W). Thereby, it is an 
N^^'-realizer for node i of length n. By Proposition 3] the repetitive and explorative completions 
finally give the following upper bounds on system transients. 



11 



(a) Repetitive realizer 



(b) Explorative realizer 



Figure 3: Repetitive and explorative realizcrs 
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Theorem 4 (Repetitive Bound) . Denoting by g the maximum girth of strongly connected components 
of G c , the transient of the linear max-plus system (A,v) is at most 

\ |H| + (A nc -S).(N-l) \ 

Theorem 5 (Explorative Bound). Denoting by 7 and ep the maximum cyclicity and maximum 
exploration penalty of strongly connected components of G c , respectively, the transient of the linear 
max-plus system {A, v) is at most 

max t A — A ' ^ 7 _ ' 1 ' ' ~ ' €P I ' 

Because g is greater or equal to 7, the two bounds represent a tradeoff between choosing a larger 
multiplicative term versus the addition of the term ep. It depends on the critical subgraph G c which 
of the two bounds is better, and our two bounds are thus incomparable in general: As an example 
for which the explorative bound is lower than the repetitive bound, consider the family of graphs Eu 
depicted in Figure [4] Ek consists of two joint cycles of length k and k+1, respectively. All edges 
have zero weight. Independent of the initial vector v, the critical bound is N, since A nc = —00. With 
TV" = 2k, g = k, and 7=1, the repetitive bound is 4fe 2 — k — 1, and the explorative bound is at most 
2k 2 + 4k — 2. For k > 3 the explorative bound is strictly lower than the repetitive bound. Conversely, 
the repetitive bound is lower than the explorative bound, if we add a self-loop at the node that is 
shared by the two cycles in the above example. 

Interestingly, the two terms in our transience bounds that are due to the repetitive and explorative 
completions are both at most quadratic: this is obvious for the repetitive term, and is an immediate 
corollary of Theorem [3] for the explorative term. In the case of integer matrices, for a given initial 
vector, both the repetitive and the explorative bounds are in 0(||j4|| ■ TV 3 ) since the critical bound 
itself is in 0(||j4|| • iV 3 ) in this case (see Equation (JT2J) . 

Hartmann and Arguelles [20] established the best previously known bound on system transients. 
Their approach includes passing to the max-balancing [24] of G and considering an increasing se- 
quence of threshold graphs which all include the critical subgraph. Their technique to increase the 
length of maximum weight walks is comparable to our repetitive pumping technique. They proved 
that the transient of system {A, v) is upper-bounded by max ((|M| + P||-iV)/(A-A ), 27V 2 ) where A 
is defined in terms of the max-balancing of G. The first term in their bound is in general incompa- 
rable with our critical bound, whereas the second term, namely 2N 2 , is always strictly larger than 
the second term in each of our two bounds and makes their bound at least quadratic in N. Trivially, 
the minimum of our two bounds, and of Hartmann and Arguelles' bound, yields the best currently 
known bound. 
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8 Matrix vs. System Transients 



As explained in Section [3] we can follow the same strategy as for system transients to bound matrix 
transients. For an N x N max-plus matrix A, this leads to an upper bound that is in 0(||A|| • JV 2 /(A — 
A nc ), but gives no hint on the relationships between the transient of max-plus matrix A, and the 
transients of the max-plus systems (A,v). 

In this section, we show that the transient of matrix A is actually equal to the transient of a 
specific system (A,v) where ||v|| is in 0(||A|| -A" 2 ), provided the system transient is sufficiently large, 
namely at most equal to some term quadratic in N. Combined with our upper bounds on the system 
transient established in Theorems [4] and this gives two upper bounds on the matrix transient which 
are also in 0(||A|| ■ N 2 /(X — A nc )), and so in 0(||A|| • TV 4 ) for integer matrices. 

Let ha and ua,v denote the transient of matrix A and the transient of system {A, v) , respectively. 
Obviously, tia is an upper bound on the ua,v's. Conversely, the equalities Af" = (A® 11 Cg> e 3 ) ., 
where the e"s are the unit vectors defined by e\ = if i = j and e\ = -co otherwise, show that 
max {n A e j \ j £ {1, • • • , N}j ha- Hence, 

sup {riA,i;|« G M, N } = UA ■ 

We now seek a similar expression of tia, but with finite initial vectors v, i.e., with v € B, . Reusing 
the notation 7 and ep from Theorem [S] we define: 

B = 2(N - 1) + ep + (ep(G) + 7 - 1), 

H = sup { Af£ - AfJ I h, i, j nodes of G , n > B , Afj -00} 

Clearly /1 is finite, i.e., pel. Then we consider the fi-truncated unit vectors obtained by replacing 
the infinite entries of the e J 's by — fx. 

In Proposition [6] below, we show that if B B and B is a bound on the system transients for all 
/i-truncated unit vectors, then B is also a bound on the matrix transient. A technical difficulty in 
the proof lies in the fact that, contrary to the sets W n (i— >•) which occur in the expression of the i-th 
component of linear systems, the sets W n (i,j) that we consider for matrix powers may be empty. 
The next two lemmas deal with this technicality. 

Lemma 6. For any pair of nodes i,j of G and any integer n ep(G) + 7(G) + N — 2, there exists 
a walk W from i to j such that n — £(W) G {0, . . . , 7(G) — 1}. 

Proof. Let i,j be any two nodes, and let Wo be a path from i to j. For any integer n, consider 
the residue r of n — £(Wo) modulo 7(G). By definition of ep(G), if n — £(Wo) — r ^ ep(G), then 
there exists a closed walk C starting at node j with length equal to n — £(Wo) — r. Then, Wo ■ C 
is a walk from i to j with length n — r, where r £ {0, . . . , 7(G) — 1}. The lemma follows since 
n - £(W ) - r > ep(G) as soon as n > ep(G) + (N - 1) + 7(G) - 1. □ 

Lemma 7. Let n be any integer such that n ^ ep(G) + 7(G) + N — 2. Then J 4®j n+7 ( <3 )) — —qq if 
and only if Af ™ = -00. 

Proof. It is equivalent to claim that W n+l{G) (i, j) = if and only if W" (i,j) = for any integer n ^ 
ep(G) + 7(G) + N - 2. 

Suppose W n+J{G) {i, j) # 0, and let W G W n+7(G) (i, j). By Lemma H there exists a walk 
W e W(i,j) such that n = £(W) + r with r£ (0,1,.. • ,7(G) - 1}. Lemma implies that 7(G) 
divides £{W ) - £{W) = (n + 7(G)) - (n - r) = 7(G) + r; hence 7(G) divides r. Therefore, r = 0, 
i.e., £(W) = n and thus W"(i,j) ± 0. 

The converse implication is proved similarly. □ 

Proposition 6. If n ^ B and j 4®("-+t' g) y — A® n ® v for all [i-truncated unit vectors v, then 

Proof. Let i and j be nodes in G, and let n be an integer such that n ^ B. Further let v be the 
/i-truncated unit vector with Vj — and — —fx for h 7^ j. Since i? ^ ep(G) + 7(G) + AT — 2 
and 7 = 7(G C ) is a multiple of 7(G), we derive from Lemma [7| that Af^ +1 — —00 if and only if 
Af" = ~ 00. There are two cases to consider: 

1. Af? = -00 and Af " + ~< = -00. In this case, Af " +7 = Af " trivially holds. 
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Figure 5: Walk W in proof of Proposition [7] 



2- AfJ / -oo and AfJ + '> / -oo. Recall that 

(A® n ®v). = max {ATX + v h \ h € {I, ■ ■ ■ ,N}} . 
By definition of /j, and i>, for any node h 7^ j, 

A ®n * (gin , 

A T, h - A Tj ^ v = vj - v h . 

It follows that 

(A® n ®v) i = Af? + v j . 

As n + 7 ^ n, we similarly have 

AfJ+~< = (A® n+7 ®v).- Vj = {A® n ®v).-Vj = AfJ . 
Thus Af ™ +7 = i4f™ holds also in this case. 

□ 

The key point for establishing our bound on matrix transients is the following upper bound on fx, 
which is quadratic in N. The proof uses the pumping technique developed for the explorative bound 
twice. 

Proposition 7. ji < \\A\\ ■ B 

Proof. First, we observe that each term in the inequality to show is invariant under substituting A 
by A. Hence we assume that A = 0. It follows that 

Af£ < A • (N - 1) < A • B . (16) 

We now give a lower bound on AfJ in the case that it is finite, i.e., if W n (i, j) 7^ 0. Let k be a 
critical node in the strongly connected component H of G c with minimal distance from i and let W\ 
be a shortest path from i to k. Further, let W2 be a shortest path from k to j. Let r denote the 
residue of n - 1{W X ■ W 2 ) - ep(G) modulo 'y(H), and let t = n - t(Wi ■ W 2 ) - ep(G) - r. Since t = 
(mod y(H)), and 

t> B - 2{N - 1) - e P (G) - (y(H) - l) > ep > ep(H) , 

there exists a closed walk C c of length t in component H starting at node k. Let s = ep(G) + r; 
then, s > ep{G). Moreover, s = n- £{Wi ■ C c ■ W 2 ), and Wi ■ C c ■ W 2 € W(i,j). By LemmaEl it 
follows that 7(G) divides s, because W n (i, j) 7^ 0. Hence there exists a closed walk C nc of length s 
starting at node j. 

Now define W = Wi ■ C c ■ W 2 ■ C nc . Clearly, £(W) = n and 

n(W) > 5 ■ (n - t) > S ■ (2{N - 1) + ep(G) + j{H) - l) , 

and so 

AfJ > S ■ (2(N - 1) + ep(G) +7 - l) > 6 ■ B . (17) 
From (16]) and (TTTJ) follows fj, < (A - 5) ■ B = \\A\\ ■ B. □ 

Combined with our upper bounds on the system transient established in Theorems [4] and [5] 
Propositions [S] and [7] give a repetitive upper bound and an explorative upper bound on the matrix 
transient. 
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Theorem 6. The transient of an irreducible matrix is at most equal to the minimum of the repetitive 
bound 

f- IUII • B + (A nc - 8) ■ (N - 1) , , 
maxjfi , A " Anc " . (ff-l)+2p.(iV-l) 

and the explorative bound 

max <j B , ^- — - , (7 - 1) + 2 7 • (jV - 1) + ep 

where B = 2(N - 1) + ep + {ep(G) + 7 - 1). 

Note that by Theorem [3j the term B in the above bounds is at most quadratic in N. Moreover it 
can be removed from the maximum when A nc is finite, since in this case the critical bound dominates 
the term B as A — A nc ^ A — S = \\A\\. 

Further, from Theorem [3] we immediately obtain that the transient of an irreducible matrix is in 
0(|| A\\ ■ N 2 /(\ — A nc )) if A nc is finite, and in 0(N 2 ), otherwise. In particular, for integer matrices 
the matrix transient is in 0(||A|| • TV 4 ) for integer matrices. 



9 Applications 

In this section we demonstrate how our transience bounds enable the performance analysis of various 
distributed systems, thereby obtaining simple proofs both of known and new results. 

In Section 19.11 we discuss properties of optimal cyclic schedules of a set of tasks subject to 
a set of restrictions. This problem arises, e.g., in manufacturing, time-sharing of processors in 
embedded systems, and design of compilers for scheduling loop operations for parallel and pipelined 
architectures. By applying our transience bounds to a naturally arising special case of restrictions 
(with binary heights), we are able to state explicit upper bounds, and thereby asymptotic upper 
bounds, on the number of task executions from where on the schedule becomes periodic. 

In Section 19.21 we discuss the transient behavior of the a network synchronizer 2 . The a- 
synchronizer constructs virtually synchronous rounds in a strongly connected network of processes 
that communicate by message passing with constant transmission delays. Its time behavior can be 
described by a max-plus linear system. It has hence a periodic behavior and by applying our results, 
we obtain upper bounds on the time from which on the system is periodic. We show that our bounds 
are strictly better than those by Even and Rajsbaum [IB]. In the case of integer matrices considered 
by Even and Rajsbaum, our bounds are in 0(||A|| ■ iV 3 ) which we show to be asymptotically tight. 

In Section 19.31 we further exemplify the applicability of our results to distributed algorithms 
by deriving upper bounds on the termination time of the Full Reversal algorithm when used for 
routing [17] , and the time from which on it is periodic when used for scheduling [3]. 



9.1 Cyclic scheduling 

Cohen et al. [13] have observed that, in cyclic scheduling, the class of earliest schedules can be 
described as max-plus linear systems. In this section, we show how to use this fact and our general 
bounds to derive explicit upper bounds on transients of earliest schedules. 

If a finite set T of tasks (each of which calculates a certain function) is to be scheduled repeatedly 
on different processes, precedence restrictions are implied by the data flow. These restrictions are of 
the form that task i may start its number n execution only after task j has finished its number n — h 
execution. A schedule t maps a pair (i,n) G T x IN to a nonnegative integer t(i,n), the time the 
number n execution of task i is started. Formally, if Pi denotes the processing time of task i, then a 
restriction R between two tasks i and j is an inequality of the form 

\/n^h R : t(i, n) > t{j, n - h R ) + Pj (18) 

where ha is called the height of restriction R and Pj is its weight. 

A uniform graph [19] describes a set of tasks and restrictions. Formally, it is a quadruple G u = 
(7~, E,p,h) such that (T,E) is a directed (multi-)graph, and p : E — > IN* and h : E —> IN are two 
functions, the weight and height function, respectively. For a walk W in G u , let p(W) be the sum of 
the weights of its edges and h(W) the sum of the heights of its edges. An edge from i to j corresponds 
to a restriction R between i and j of the form (|18[) . All incoming edges of a node j in T have the 
same weight, namely Pj. An example of a uniform graph is Figure 6( 
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(a) Uniform graph G u . Edges are labeled with pro- 
cessing times, and heights in brackets 



(b) Graph G(A) 



Figure 6: Example of a set of tasks with restrictions 



Call G u well-formed if it is strongly connected and does not contain a nonempty closed walk of 
height 0. Call a schedule t an earliest schedule if it satisfies all restrictions specified by G" and it 
is minimal with respect to the point-wise partial order on schedules. Denote the maximum height 
in G u by h. Cohen et al. 13 showed that the earliest schedule t for well-formed G u is unique and 
fulfills 

t{i,n) = [A 9n ®v) i (19) 

for all i £ T and n ^ 0, where v is a suitably chosen (h ■ |T|)-dimensional max-plus vector and A a 
suitably chosen (h ■ \T\) X (h ■ |T|) max-plus matrix. In case heights in G u are binary, i.e., either 



or 1, as in our example in Figure 6(b) A and v are obtained as follows: For all i, j 
maximum weight of nonempty walks W from i to j in G u , where all of W's edges have height 0, 
except for the last edge, which has height 1. In case no such walk exists, Aij = — oo. For all i 6 T, 
Vi is the maximum weight of walks W from i in G u , where all of W's edges have height 0. As an 



example the graph G(A) for the uniform graph in Figure 6(a) is depicted in Figure 6(b) For this 
example we obtain the initial vector v — (0,1,4,6,11,0,3). We can, however, not directly apply 
our transience bounds on the graph G(A) obtained from G", since G(A) is not necessarily strongly 



connected, as it is the case for the example in Figure 6(b) 

However, we present a transformation of G u that yields a strongly connected graph G(A) in case 
of binary heights, and has the same earliest schedule as the original graph G u : For every restriction 
between tasks i and j in G u one can add the redundant restriction t(i, n) ^ t(j, n — 1) + Pj without 
changing the earliest schedule, since t(j,n) ^ t(j,n — 1) for all tasks j and n ^ 1. With this 
transformation we obtain: 

Proposition 8. If G u is well-formed, has binary heights, and contains all redundant restrictions, 
then A is irreducible. 

Proof. It suffices to show that whenever there is an edge from i to j in G u , then it also exists in G(A). 
Because G u contains all redundant restrictions, if there exists an edge from i to j, then there also 
exists an edge of height 1 from i to j. Hence there exists a walk of length 1 from i to j in G u whose 
last (and only) edge has height 1. Hence, by definition of A, the entry Aij is finite. This concludes 
the proof. □ 



Figures 7(a) and 7(b) depict the transformed graph G u of the above example with redundant 



restrictions and its corresponding weighted graph G(A). Observe that, in contrast to Figure 6(b) 



G(A) is strongly connected in Figure [7(b) | 

Because of (I19|) and Proposition [8] we may now directly apply Theorems [4] and [5] to (the strongly 
connected) graph G(A), obtaining upper bounds on the transients of the earliest schedule for G". 

For the given example, ||w|| = 11, the critical circuit is from node 7 to 5 and back, A = 6.5, 
A nc = 6, A nc = 8, 5 = 1, g = 2, 7 = 2, ep = 0, and we obtain a critical bound of 106. Since the 
critical bound dominates both the repetitive and explorative bound of Theorems[4]and[5]respectively, 
106 is an upper bound on the transient of the earliest schedule. The discrepancy to the transient of 
the earliest schedule, which is 1, stems from the fact that the critical bound is overly conservative 
for this example. 

Bounds in terms of the parameters of the original uniform graph G u can be derived as well by 
relating graph parameters of G u to parameters of G — G(A). For that purpose, we denote by S(G U ) 
and A(G U ) the minimum and maximum weight of an edge in G u , respectively. From the definition 
of max-plus matrix A and initial vector v, it immediately follows that in case of binary heights, 
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(a) Uniform graph G u with redundant restric- (b) Graph G(A). Edges due to redundant restric- 
tions (dotted). tions are dotted. 

Figure 7: Transformation of G u in case of binary heights. 

= |T|, H < (|71 - 1) ■ A(G"), A(G) < |T| • A(G U ), 5(G) > S(G U ), 

A(G) = max{p(C)/h(C) \ C is a closed walk in G u } , 

Anc(G) is at most the second largest p(C)/h(C) of closed walks G in G u , and g(G) is at most 
the number of links with height 1 in closed walks G in G u with maximum p(C)/h(C). As a con- 
sequence of the above bounds and the bound stated in (|12p for integer matrices, the transient is 
in 0((A(G) - 6(G)) ■ \T\ 3 ) = 0{\T\ 4 ), assuming constantly bounded S(G U ) and A(G"). To the best 
of our knowledge, this is the first asymptotic bound on the transient of an earliest schedule with 
tasks T and binary heights. It is an open problem whether this bound in |T| is asymptotically tight. 

9.2 Synchronizers 

Even and Rajsbaum \W\ presented a transience bound for a network synchronizer in a system with 
constant integer communication delays. They considered a variant of the a-synchronizer [5] in a 
centrally clocked distributed system of TV processes that communicate by message passing over a 
strongly connected network graph G. Each link has constant transmission delay, specified in terms 
of central clock ticks. Processes execute the a-synchronizer after an initial boot-up phase: After 
receiving round n messages from all neighbors, a process proceeds to round n + 1 and broadcasts its 
round n + 1 message. Denote by t(n) the vector such that ti(n) is the clock tick at which process i 
broadcasts its round n message. Even and Rajsbaum showed that the synchronizer becomes periodic 
by time Ber = lo + 27V 2 + TV ', where lo is an upper bound on the length of maximum weight walks 
with only non-critical nodes. It is easily checked that lo is always greater or equal to our critical 
bound B c . 

One can show that t(n) is in fact a max-plus linear system. More precisely, t(n) = A® n ® t(0), 
where A is the adjacency matrix of the network graph G. Our bounds hence directly apply, and we 
obtain a repetitive bound on the transient of (t(n)) n ^o that is strictly less than max{7o, 2TV 2 — TV}, 
and thus strictly less than Even and Rajsbaum's bound 73er- 

As an example, let us consider the "£-sized cherry" graph family Ht tC , with £ ^ 2 and c ^ 1, 
introduced by Even and Rajsbaum |16| . Each weighted graph Hp^ c contains TV — 41 nodes and is 
constructed as follows: Let G and G be two cycles of length £ and £ + 1 respectively, with edge 
weights 3c, except for one link per cycle with weight 3c + 1. There exists for both C and C a path 
of length £ to a distinct node s, and an antiparallel path back. Hereby the edges in the path from s 
to G and from s to G have weight c, the edges in the path from G to s have weight 3c, and from G 
to s, 4c. 

Observing that the nodes of G are the critical nodes, A = 4c, 8 — c, N — 4£, A = 3c + l/£, and 
l = 112c£ 3 - 16£ a - 12c£ 2 +U-1, Even and Rajsbaum's bound is 

(112c - 16)£ 3 + (32 - \2c)£ 2 +U-1 , 

resulting in an upper bound of 5711 on the transient in case of 7/3,2- Since A nc = A and A nc = 
3c+l/(l + l), we obtain for the critical bound B c = 3c£(£ + 1)(TV- 1) = 12c£ 3 + 9c£ 2 - 3ci. Moreover 
for the critical subgraph G c , the maximum girth of strongly connected components of G c is g = I. 
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Thereby we may bound the transient of (i(n)) n ^o with Theorem [4] by 

max{B c ,2W -t-l} = max{B c , S£ 2 - I - 1} = 12c£ 3 + 9c£ 2 - 3c£ , 

resulting in an upper bound of 792 on the transient in case of 1/3,2- 

Since Even and Rajsbaum express transmission delays with respect to a discrete global clock, all 
weights are integers. Both our transience bounds are in 0(||j4|| ■ TV 3 ). The example graph family 
shows that this is asymptotically tight since Even and Rajsbaum proved that the transient for graph 
H c j is in Q(c ■ £ :i ) — fi(||.A|| • TV 3 ). An adapted example graph family shows asymptotic tightness of 
our bounds in the general case. 

9.3 Full Reversal routing and scheduling 

Link reversal is a versatile algorithm design paradigm, which was, in particular, successfully applied 
to routing |17| and scheduling [3]. Charron-Bost et al. [9] showed that the analysis of a general 
class of link reversal algorithms can be reduced to the analysis of Full Reversal, a particularly simple 
algorithm on directed graphs. 

The Full Reversal algorithm comprises only a single rule: Each sink reverses all its (incoming) 
edges. Given a weakly connected initial graph Go without antiparallel edges, we consider a greedy 
execution of Full Reversal as a sequence (Gt)t^o of graphs, where Gt+i is obtained from Gt by 
reversing the edges of all sinks in Gt- As no two sinks in Gt can be adjacent, Gt+i is well-defined. 
For each t ^ we define the work vector W(t) by setting Wi(t) to the number of reversals of node i 
until iteration t, i.e., the number of times node i is a sink in the execution prefix Go, . . . , Gt-i- 

Charron-Bost et al. [8] have shown that the sequence of work vectors can be described as a min- 
plus linear dynamical system. Min-plus algebra is a variant of max-plus algebra, using min instead of 
max. Denoting by (g/ the matrix multiplication in min-plus algebra, Charron-Bost et al. established 
that W(0) = and W(t + 1) = A <8>' W(t), where Aij = 1 and Aj,i = if is an edge of the 
initial graph Go; otherwise Ai t j = +00. Observe that the latter min-plus recurrence is equivalent 
to — W(t + 1) — (—A) ® (— W(t)) where —A is an integer max-plus matrix with A nc € {0, —1} and 
5 = -1. 

9.3.1 Full Reversal routing 

In the routing case, the initial graph Go contains a nonempty set of destination nodes, which are 
characterized by having a self-loop. The initial graph without these self-loops is required to be weakly 
connected and acyclic [8] [17] . It was shown that for such initial graphs, the execution terminates 
(eventually all Gt are equal), and after termination, the graph is destination-oriented, i.e., every 
node has a walk to some destination node. We now show how the previously known results that the 
termination time of Full Reversal routing is quadratic in general [6] and linear in trees [8] directly 
follows from both Theorem [3] and Theorem 

The set of critical nodes is equal to the set of destination nodes and each strongly connected 
component of G c consists of a single node. Hence A = and A nc ^ — l/TV nc ^ — 1/(TV — 1), 
i.e., (TV — l) 2 is an upper bound on the critical bound. Since g = 1, we obtain from Theorem^ for 
N ^ 3, that the termination time is at most (N — l) 2 , which improves on the asymptotic quadratic 
bound given by Busch and Tirthapura [6]. 

If the undirected support of initial graph Go without the self-loop at the destination nodes is a 
tree, we can use our bounds to give a new proof that the termination time of Full Reversal routing 
is linear in N [8] Corollary 5]. In that particular case either A nc = —1/2 or A nc = — 00. In both 
cases the critical bound is at most 2(iV — 1). Both Theorem|3]and Theorem [S] yield the linear bound 
2 (TV — 1), whereas Hartmann and Arguelles arrive at 27V" 2 . 
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9.3.2 Full Reversal scheduling 

When using the Full Reversal algorithm for scheduling, the undirected support of the weakly con- 
nected initial graph Go is interpreted as a conflict graph: nodes model processes and an edge between 
two processes signifies the existence of a shared resource whose access is mutually exclusive. The 
direction of an edge signifies which process is allowed to use the resource next. A process waits until 
it is allowed to use all its resources — that is, it waits until it is a sink — and then performs a step, that 
is, reverses all edges to release its resources. To guarantee liveness, the initial graph Go is required 
to be acyclic. 

Contrary to the routing case, strongly connected components of the critical subgraph have at 
least two nodes, because there are no self-loops. By using (|f 2p . we get TV 2 (TV — l)/4 as an upper 
bound on our critical bound, which shows that the transient for Full Reversal scheduling is at most 
cubic in the number TV of processes. Malka and Rajsbaum |23l Theorem 6.4] proved by reduction to 
Timed Marked Graphs that the transient is at most in the order of 0(N 4 ). Thus, our bounds allow 
to improve this asymptotic result by an order of TV. 

In the case of Full Reversal scheduling on trees we even obtain a bound linear in TV: In this case 
it holds that A = —1/2, and A nc = — oo. Thus the critical bound is TV. Further, G c = G and g = 2. 
Both Theorem [4] and Theorem [5] thus imply that 47V — 3 is an upper bound on the transient of 
Full Reversal scheduling on trees, which is linear in TV. This was previously unknown. By contrast 
Hartmann and Arguelles again obtain the quadratic bound of 27V 2 . 
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